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Abstract 

We introduce a notion of variable quasi-Bregman monotone sequence which unifies the notion 
of variable metric quasi-Fejer monotone sequences and that of Bregman monotone sequences. 

The results are applied to analyze the asymptotic behavior of proximal iterations based on vari¬ 
able Bregman distance and of algorithms for solving convex feasibility problems in reflexive real 
Banach spaces. 
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1 Introduction 


The concept of Fejer monotonicity and its variants plays an important role in the convergence anal¬ 
ysis of many fixed point and optimization algorithms in Hilbert spaces IfTl [5l 7, '8 , [TO |T7 1 . A recent 
development in this area is the extension of the notion of (quasi)-Fejer sequence to the case when 
the underlying metric is allowed to vary over the iterations |{9]] . Since Fejer monotonicity is of limited 
use outside of Hilbert spaces, the notion of Bregman monotonicity was introduced in 0] to provide 
a unifying framework for the convergence analysis of various algorithms for solving nonlinear prob¬ 
lems. The main objective of the present paper is to unify the work of [9]] on variable metric Fejer 
sequences and that of 0 on Bregman monotone sequences by introducing the notion of a variable 
quasi-Bregman monotone sequence and by investigating its asymptotic properties. We apply these 
results to a variable Bregman proximal point algorithm and to convex feasibility problems in Banach 
spaces. Our paper revolves around the following definitions. 


Definition 1.1 00 Let X be a reflexive real Banach space, let X* be the topological dual space of 
X, let (•, •) be the duality pairing between X and X*, let /: X —> ]—oo, Too] be a lower semicontinu- 
ous convex function that is Gateaux differentiable on int dom/ / 0, let f*:X*^- ]—oo, +oo] : x* i-t 
sup x . e *((x' : x*) — f(x)) be conjugate of /, and let 

df:X^2**:x^{x*eX* | (Vy € *) (y - x, x*) + f(x) < f(y)}, (1.1) 

be Moreau subdifferential of /. The Bregman distance associated with / is 

D? : X x X —> [0, Too] 

( //(*)-/(y)-(*-y>V/(i/)), if y € int dom/; (1.2) 

^ |+oo, otherwise. 

In addition, / is a Legendre function if it is essentially smooth in the sense that df is both locally 
bounded and single-valued on its domain, and essentially strictly convex in the sense that df* is 
locally bounded on its domain and / is strictly convex on every convex subset of dom df. Let 
p: X — > ]—oo, Too] be a lower semicontinuous convex function which is bounded from below and 
dom p n int dom/ f 0. The Df -proximal operator of <p is 

prox£: int dom/ —>• dom ip n int dom/ 

f I OA 

y i-t argmin<p(x) T D^(x, y). y J 


Let C be a closed convex subset of X such that C n int dom/ 0. The Bregman projector onto C 
induced by / is 


pj -,: int dom/ —> C (T int dom/ 

y ^ argmin D f (x,y), 

XClC 

and the 1)1 -distance to C is the function 

D^,: X —> [0, Too] 

y ^ inf D f (C, y). 


(1.4) 


(1.5) 
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The paper is organized as follows. In Section [2l we introduce the notion of a variable quasi- 
Bregman monotone sequence and investigate its asymptotic properties. Basic results on -proximal 
operators are reviewed in Section [3] Applications to a variable Bregman proximal point algorithm 
and to the convex feasibility problem are considered in Section [4j 

Notation and background. The norm of a Banach space is denoted by || • ||. The symbols 
and —>• represent respectively weak and strong convergence. The set of weak sequential clus¬ 
ter points of a sequence (x n ) ne N is denoted by 2U(x n ) nG N- Let M: X —>• 2 X . The domain of 
M is domM = {iff | Mx / 0}, the range of M is ranM = {y £ X | (3x £ X) y £ Mx], 
the graph of M is graM = {(x,y) £ X x X | y £ Mx], and the set of fixed points of M is 
FixM = {x £ X | x £ Mx]. A function /: X —>• ]— 00 ,+ 00 ] is coercive if lim|| ;z .||_ H _ 00 /(x) = + 00 . 
Denote by ro(A’) the class of all lower semicontinuous convex functions /: X —>• ]—cx>,+cx3] such 
that dom / = {x € X | /(x) < + 00 } / 0. Let / e To(<T). The set of global minimizers of a function 
/ is denoted by Argmin /. In addition, if / is Gateaux differentiable on int dom/ / 0 then 

f : X—t ]—00, +00] 

f/(x), if xG int dom/; (1-6) 

x 1 —y \ 

l+oo, otherwise. 

Finally, f+(N) is the set of all summable sequences in [0, +00[. 


2 Variable Bregman monotonicity 

Definition 2.1 Let A be a reflexive real Banach space and let / £ Tc/fL) be Gateaux differentiable 
on int dom/ / 0. Then 

T(/) = {g 6 To(A’) | 5 is Gateaux differentiable on dom g = int dom/}. (2.1) 

Moreover, if g\ and g 2 are in 3 ~(/), then 

9 i >92 (Vx € dom/)(Vy G int dom/) D 91 {x,y) ^ D 92 {x,y). (2.2) 

For every a £ [0, +00 [, set 

?«(/) = {$€?(/) | < 7 ^ a/}. (2.3) 

Remark 2.2 In Definition 12.11 suppose that A is a Hilbert space and let a € ]0, +oo[. Then the 
following hold: 

(i) Suppose that / is Frechet differentiable on X. Then || • || 2 /2 £ (P a (f) if and only if V/ is 
a -1 -Lipschitz continuous. 

(ii) Let S(<T) be the space of self-adjoint bounded linear operators from X to X. The Loewner 
partial ordering on §(X) is defined by 

(VE/i £ §(X))(yU 2 £ S(X)) Ui^U 2 ^ (Vx £ X) (x, U\x) > (x, U 2 x). (2.4) 
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Set T a (X) = {U £ S(X) | U > aid}. Let U £ S(AT) and V £ 8(X) be such that V ^ aU. 
Suppose that f:x*->(x, Ux)/2 and g: x *->• (x, Vx)/2. Then g £ T a (f)- 

Proof. [CiJt First, since / is Frechet differentiable, df = V/ JS] Proposition 17.26] and hence, by If5l 
Corollary 16.24], (V/) -1 = ( df ) _1 = df*. Now, we have 

II • || 2 /2 € V a (f) ** (Vx € X)(fJy £ X) \\x - y\\ 2 /2 > aD^(x,y) 

(Vs € X){My £ X) ||x - y\\ 2 /(2a ) > /(x) - f(y) -(x-y, V/(y)) 

^ (Vx £ X)(\/y £ X) f(x) ^ f(y) + (x - y, V/(y)) + ||x - y|| 2 /(2a). (2.5) 

The assertion therefore follows by invoking [ 5] Theorem 18.15]. 

GH) We observe that / and g are Gateaux differentiable on X with V/ = U and Vy = V. 
Consequently, 

(Vx € *)(Vy G X) D 9 (x, y) = (x, Vx)/2 - (y, Vy)/2 -(x-y, Vy) 

= (x -y,Vx - Vy)/2 
^ a(x — y, Ux — Uy)/2 

= aD f (x,y). (2.6) 


□ 

Example 2.3 Let X be a reflexive real Banach space, let / £ To(<T) be Gateaux differentiable on 
int dom/ f 0, let a £ [0, +oo[, and let g £ To(-T) be Gateaux differentiable on dom g = int dom/. 
Suppose that and g — af is convex (which means that g is more convex than af in the terminology 
of J. J. Moreau Ill4ll ). Then g £ (P a (/). 

Proof. We first note that dom/i = int dom/. Since / and g are Gateaux differentiable on int dom/ 
by 1)151 Proposition 3.3], h = g — af is likewise. Furthermore, 

(Vx € dom/)(Vy € intdom/) D 9 (x, y) — aD^(x, y) = D h (x, y) ^ 0. (2.7) 


□ 


The following definition brings together the notions of Bregman monotone sequences 01 and of 
variable metric Fejer monotone sequences 

Definition 2.4 Let X be a reflexive real Banach space, let f £ Fq(X) be Gateaux differentiable on 
int dom/ 0, let (/ n )neN be in T(/), let (x n ) nG N £ (int dom/) N , and let C C X be such that 

C n dom / / 0. Then (x n ) nG N is: 

(i) quasi-Bregman monotone with respect to C relative to (/ n )neN if 

(3(y n )neN € f+(N))(Vx £ C n dom /)(3(e n ) ng pj £ f+(N))(V?r £ N) 

D fn+1 (x,x n+ 1 ) ^ (1 + rj n )D fn (x,x n ) + e n \ (2.8) 
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(ii) stationarily quasi-Bregman monotone with respect to C relative to (/ n )neN if 


(3(e n )nGN e ^+(N))(3(ry n ) neN G £+(N))(Vx G C r dom f)(\/n G N) 

D fri+1 (x,x n+ 1 ) ^ (1 + rj n )D fn (x,x n ) + e n . (2.9) 


Remark 2.5 


(i) In Definition 12.41 suppose that (Vn G N) f n = / and rj n = e n = 0. Then we recover the notion 
of a Bregman monotone sequence defined in ||4]]. 

(ii) In Definition 12.41 suppose that X is a Hilbert space, that / = || ■ || 2 /2, and that (Vn G N) 
/„: ig (x,U n x)/ 2 , where (C/ n ) ne n are operators in T a (X) for some a G [0,+oo[. Then we 
recover |[9l Definition 2.1] with cf> = | • | 2 /2. 


Here are some basic properties of quasi-Bregman monotone sequences. 

Proposition 2.6 Let X be a reflexive real Banach space, let f G To(<T) be Gateaux differentiable on 
int dom/ f 0, let a G ]0, +oo[, let (J n )v.m be in T Q (/), let ( x n ) ne n € (int dom f) N , let C C X be such 
that C fl int dom/ / 0, and let x G C n int dom/. Suppose that (x n ) nG N is quasi-Bregman monotone 
with respect to C relative to (f n )nm- Then the following hold: 

(i) (D fn (x,x n )) neN converges. 

(ii) Suppose that D? (x, •) is coercive. Then (x n ) nS N is bounded. 


Proof. [(!)] Let us set (Vn G N) („ = D^ n (x,x n ). Since ( x n ) ne ^ is quasi-Bregman monotone with 
respect to C relative to there exist (p n )neN € (+(N) and (e n ) ne rj G (+(N) such that 

(Vn G N) Zn+l ^ (1 + Pnjfn + £ n- (2.10) 

It therefore follows from lfT6l Lemma 2.2.2] that (£ n ) n eN converges, i.e., (Df n (x, x n )) n 6 n converges. 


(ii)l Since (/ n )neN is in Taif), we deduce that 


(Vn G N) D^(x,x n ) ^ a 1 D^ n (x,x n ). 


( 2 . 11 ) 


Therefore, since [(!)] implies that (Df n (x,x n )) n <zf$ is bounded, (D? (x, Xn))neN is bounded. In turn, 
since D?(x, •) is coercive, (x n ) nS M is bounded. □ 

The following result concerns the weak convergence of quasi-Bregman monotone sequences. 


Proposition 2.7 Let X be a reflexive real Banach space, let f G To(<T) be Gateaux differentiable on 
int dom/ f 0, let (x n ) rie ^ G (int dom/) N , let C C X be such that C n int dom/ 0, let ( p n ) ns n G 

(+(N), let a G ]0, +oo[, and let (f n ) n m Ja(/) be such that (Vn G N) (1 +%)/ n V f n + 1 - Suppose that 
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(x n ) ne ^ is quasi-Bregman monotone with respect to C relative to (f n )nm> that there exists g G 3~(/) 
such that for every n G N, g )p f n , and, for every x\ G X and every X 2 G X, 

x\ g n c 

< X2 G Cl C => X\ = X 2 . (2.12) 

k «*i - * 2 , V/„(x„))) neN converges 

Moreover, suppose that (Vx G int dom/) (x, •) is coercive. Then (x n ) nS N converges weakly to a point 
in C n int dom/ if and only if 2U(x n ) ne N C C n int dom/. 

Proof. Necessity is clear. To show sufficiency, suppose that every weak sequential cluster point 
of (x n ) n£ N is in C D int dom/ and let x± and X 2 be two such points. First, it follows from Proposi¬ 
tion 12. am I that 

(D fn (x i,x n )) neN and (D fn (x 2 ,x n )) nm are convergent. (2.13) 

Next, let us define the following functions 

f: [0,1] f (xi-x 2 , Vy(x 2 +i(xi-x 2 )) - Vy(x 2 )), (2.14) 

and 

(Vn G N) 4> n : [0,1] —>■ M : f i-» (x\ — x 2 , V/ n (x 2 + t(x\ — x 2 )) — V/ n (x 2 )). (2.15) 

Then 

[ 4>(t)dt = g(x i) - g(x 2 ) and (Vn G N) [ f n (t)dt = f n (x i) - /„(x 2 ). (2.16) 

io Jo 

For every n G N, since (1 + g n )f n ^ / n +i> for every t G ]0,1]), we have 

K+i (t) = (xi - x 2 ,V/ n+ i(x 2 + f(xi - x 2 )) - V/ n+ i(x 2 )) 

= f _1 (x 2 + t(xi - x 2 ) - x 2 , V/ n _|_i(x 2 + t(xi - x 2 )) - V/„+i(x 2 )) 

= t^ 1 {D fn+1 (x 2 + t(xi - x 2 ),x 2 ) + Z>f n+1 (x 2 ,x 2 + f(xi - x 2 ))) 

< (1 + Pn)t l (D?" (x 2 + t(xi - X 2 ),X 2 ) + D fn (x 2 ,x 2 + f(xi - X 2 ))) 

= (1 + 1 ln)t~ 1 (x 2 + t{x 1 - X 2 ) - X 2 , V/ n (x 2 + t(xi - X 2 )) - V/ n (x 2 )) 

= (1 + %)(xi - x 2 , V/ n (x 2 + f(xi - x 2 )) - V/ n (x 2 )) 

= (1 + 77„)</ n (f). (2.17) 

Consequently, 

(Vn G N)(Vi G ]0,1]) 0 ^ </ n +i(f) ^ (1 + p n )fn{t). (2.18) 

It is clear that (12.18ft is valid for t = 0 since in this case, all terms are equal to 0. In turn, we deduce 
from f[l6l Lemma 2.2.2] that 

(^n)ngi converges pointwise. (2.19) 
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On the other hand, for every n G N, since g /„, the same argument as above shows that 


(V* e [0,1]) o <&,(*)< ^(t). (2.20) 

By invoking ( 12.191) , (12.201) . and Lebesgue’s dominated convergence theorem, we obtain that 


(j) n (t)dt 


) 


converges, 


( 2 . 21 ) 


/ nSN 


which implies that 

(/nOo) - fn 

We also observe that 


nCN 


converges. 


( 2 . 22 ) 


(Vn G N) D fn (xi,x n ) - D fn (x 2 ,x n ) = f n (x i) - f n (x 2 ) - (xi - x 2 , V/„(x n )), (2.23) 

and hence, it follows from (12.131) and (12.221) that 

((xi -x 2 ,V/ n (s„))) ngN converges. (2.24) 

In turn, (12.12D forces x\ = x 2 . Since Proposition 12.^KiiT| asserts that (x n ) ne N is bounded and since X 
is reflexive, we conclude that x n —*• x\ G C n int dom/. □ 


Example 2.8 Let X be a reflexive real Banach space, let / G To(<T) be Gateaux differentiable on 
int dom/ ^ 0, let (f n )ne n be i n 3"(/), let (x n ) nS N G (int dom/) N , and let C c X. Suppose that 
C n dom / is a singleton. Then (12.121) is satisfied. 


Proof. Since (x n ) nS N G (int dom f) N , 2U(x n ) nG N C dom /, and therefore, 2U(x n ) n€ N n C is at most a 
singleton. □ 

Example 2.9 Let X be a reflexive real Banach space, let / G ro(<T) be Gateaux differentiable on 
int dom/ / 0, let (x n ) nG N € (int dom/) N , let C C int dom/, and set (Vn G N) f n = /. Suppose that 
/lint dom/ is strictly convex and that V/ is weakly sequentially continuous. Then (12.12D is satisfied. 


Proof. Suppose that xi G 2B(x n ) ne NnC' and x 2 G 2B(x n ) ne NnC' are such that ((xi - x 2 , V/ n (x n )) ne N 

converges and xi / x 2 . Take strictly increasing sequences (/c n )neN an d (l n )ne n i n N such that 
x kn —^ xi and xi n — 1 X 2 - Since V/ is weakly sequentially continuous, by taking the limit in (12.121) 
along subsequences (x fe J neN and (xi n ) neN , we get 


(xi-x 2 ,V/(xi)-V/(x 2 )) = 0 (2.25) 

Since /|i nt dom/ is strictly convex, V/ is strictly monotone |fT9l Theorem 2.4.4(h)], i.e., 


(xi - x 2 , V/(xi) - V/(x 2 )) > 0, 


(2.26) 


and we reach a contradiction. □ 
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Example 2.10 Let X be a real Hilbert space, let / = || ■ || 2 /2, let C C X, let (x n ) ne ^ be a sequence in 
X, let a £ ]0, +oo[, let U and ( U n ) n be self-adjoint linear operators from X in X such that U n —>• U 
pointwise, and set (Vn £ N) f n = (•, U n -)/2. Suppose that (•,[/•) ^ a\\ • || 2 . Then (12.12ft is satisfied. 

Proof. It is easy to see that, for every n £ N, f n is Gateaux differentiable on X with V/ n = U n . 
Suppose that x\ £ 2U(x n ) ne N n C and x 2 £ W(x n ) neN n C are such that ((xi - x 2 , V/ n (x n )) nS N 
converges. Take strictly increasing sequences (fc n ) n6 N and (l n )neN in N such that x kn — ^ x\ and 
%i n x 2 . We have 


(xi - x 2 , V/ fe „(x fe j) = (xi - x 2 ,U kn x kn ) = (U kri x i - U kn x 2 ,x kn ) ->■ (Uxi - Ux 2 ,x i), (2.27) 


and 


(xi ~ X 2 , Vfi n (xiJ) = (x! -x 2 ,Ui„xi n ) = (Ui n x 1 - Ui n x 2 ,x in ) —>■ (Ux 1 - Ux2,x 2 ), (2.28) 

and hence, 0 = (Ux i — Ux 2 ,x± — x 2 ) ^ a||xi — X2II 2 , and therefore, x\ = x 2 . □ 

The following condition will be used subsequently (see 0, Examples 4.10, 5.11, and 5.13] for 
special cases). 

Condition 2.11 0 Condition 4.4] Let X be a reflexive real Banach space and let / £ To((E) be 
Gateaux differentiable on intdom/ f 0. For every bounded sequences (x n ) n& ^ and ( y n )n,m in 
int dom/, 

D f {x n , y n ) -» 0 =4> x n - y n -£ 0. (2.29) 

We now present a characterization of the strong convergence of stationarily quasi-Bregman 
monotone sequences. 

Proposition 2.12 Let X be a reflexive real Banach space, let f £ To((E) be a Legendre function, let 
a £ ]0, +oo[, let (fn)neN be in (P a (f), let (. x n ) ne n £ (intdom/) N , and let C be a closed convex subset 
of X such that C D int dom/ f 0. Suppose that ( x n ) ne ^ is stationarily quasi Bregman monotone with 
respect to C relative to (f n )n.m> that f satisfies Condition ^. 11\ and that (Vx £ int dom/) D? (x, •) is 
coercive. In addition, suppose that there exists (5 £ ]0, +oo[ such that (Vn £ N) /3f f n . Then (x n ) ne pj 
converges strongly to a point in C n dom / if and only if lirn Df(x n ) = 0. 

Proof. To show the necessity, suppose that x n —>■ x £ C n dom / and take x £ C n int dom/. Since 
Proposition I2.dl(i)l states that (Df n (x, x n )) n ^ is bounded and since 

(Vn £ N) D?(x, x n ) ^ D^ n (x,x n ), (2.30) 

we deduce that (Df (x,x n )) nS N is bounded. However, by 0] Lemma 7.3(vii)], 

(Vn £ N) H / ‘(V/(x n ),V/(x)) =Df(x,x n ). (2.31) 
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Therefore (f9-f*(V/(x n ), V/(x))) n£ N is bounded. In turn, since V/(x)) is coercive 1151 

Lemma 7.3(v)], we get (V f(x n )) ne ^ is bounded and hence (x — x n , V/(x n )) —>• 0. Since 

(Vn G N) Dg(x n ) = inf D^(C, x n ) 

< inf b'^Cn dom /, x n ) 

^ D f (x,x n ) 

= /(x) - /(x n ) - (x - x n , V/(x n )), (2.32) 

we obtain 

limT)^(x n ) ^ /(x) - lim /(x n ) - lim (x - x n , V/(x„)) = /(x) - lim/(x n ). (2.33) 

Since / is lower semicontinuous, 

/(x) ^ lim/(x n ) < lim /(x n ). (2.34) 

Altogether, (I2.33D and (I2.34D yield 

lim Djj(xr,) —>• 0. (2.35) 

We now show the sufficiency. First, since / is Legendre and C (T int dom / / 0, (II .4D yields 

Pq : int dom/ — » C fl int dom/. (2.36) 

Next, we set 

(Vn G N) Q n = D f c (x n ) and ( n = inf D fn (x,x n ). (2.37) 

mgCndom/ 

Then lim g n = 0. For every n G N, since /3f > f n £= af, we obtain 

(VxGCndom/) 0 ^ aD^(x, x n ) ^ D^ n (x, x n ) ^ / 3 D^{x, x n ). (2.38) 

In the above inequalities, after taking the infimum over xGCn dom /, we get 

(Vn G N) 0 ^ ag n ^ ( n ^ j3g n (2.39) 

and therefore, 

0 ^ a lim g n V lim ( n ^ P lim g n = 0. (2.40) 

On the other hand, since (x n ) n£ N is stationarily quasi Bregman monotone with respect to C relative 
to {f n )nm, there exist {ij n )neN € ^+(N) and ( e n)neN € £f(N) such that 

(Vx G C n dom/)(Vn G N) D fn+1 (x, x n+ i) ^ (1 + rj n )D fn (x, x n ) + e n . (2.41) 

Taking the infimum in (12.411) over C fl dom / yields 

(Vn G N) Cn+l ^ (1 + f?n)C n + e n- (2.42) 
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It therefore follows from Ill61 Lemma 2.2.2] that (Cn)neN converges, and thus, we deduce from 
(12.40D that £, n — > 0 . Appealing to (I2.39D , we get g n —» 0, i.e., 

D f (p£x n ,x n ) 0. (2.43) 

Now let x G C n int dom /. Then x € FixP^ |]4l Proposition 3.22(h) (b)] and it follows from Propo¬ 
sition [2l||T)] that (Df n (x,x n )) n is bounded, and hence, ( Df (x,x n )) ne ^ is likewise. In turn, since 
1141 Proposition 3.3(i) and Theorem 3.34] yield 

(Vn € N) D f (®, P s c x n ) < D f (.x , x n ), (2.44) 

we deduce that (D?(x, P^x n )) nG n is bounded, and hence, since D?(x, •) is coercive, we obtain that 
(P^a; n ) neN € (intdom/) N is bounded. (2.45) 

Therefore, since / satisfies Condition 12.Ill it follows from (12.431) that 

P f c x n - x n 0. (2.46) 

Since (12.361) entails that 

(Vn € N) € C n int dom/ = Fix P*, (2.47) 

we obtain 

(Vn G N) 0 ^ dc(x n ) = ini \\x - x n \\ ^ \\p£x n -x n \\. (2.48) 

x£C 

Altogether, (12.461) and (12.48D imply that 


dc{x n ) 0. 


(2.49) 


Set r = n fc€N (l + %)• Then r < +00 [12; Theorem 3.7.3], By invoking (12.471) and |]4l Proposi¬ 
tion 3.3 (i) and Theorem 3.34], we get 

(Vn G N)(Vm G N) D f (p£x n , p£x m +n) < D f (p£x n , x m+n ) 

V- OL P)f m + n {^P^Xn, 

( n+m—1 

D fn (P£x n , x n ) + ^2 

k=n 


^ra 1 


= ra 


-1 



(2.50) 


After taking the limit as n —>■ +00 and m —>• +00 in (12.500 . we obtain 

D f (p£x m+n , p£x n ) —s-0, 


(2.51) 
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(2.52) 


and thus (12.451) yield 


f f 

I—''* 'T* 

1 (j^m+n 1 Q^r 


o. 


However, 

(Vn G N)(Vm G N) ||x m _|_ n X n || ^ ||®m+n P(j3Cm+n || “I - || P(j^m+n P(yX n || 4" ^nll- (2.53) 

After taking the limit asn-> +oo and m —y +oo in (12.531) then using (12.46ft and (12.521) . we get 

X n \\ t 0* (2.54) 

Thus, (x n )neN is a Cauchy sequence in X, and hence, there exists x G X such that x n —>• x. By (12.49ft 
and the continuity of dp [S Example 1.47], we obtain dc(x) = 0 and, since C is closed, x G C. 
Because ( x n ) n& ^ is in int dom/, we conclude that x G dom/. □ 


Remark 2.13 In Proposition 12.121 suppose that X is a Hilbert space, that / = || ■ || 2 /2, and that 
(Vra G N)/„:ig (x, U n x)/2, where (f/ n )„ e m are operators in 1P a (X) such that sup ngN ||17 n || < 4-oo. 
Then we recover |{9j Theorem 3.4] with cf> = \ • [ 2 /2. 


3 Bregman distance-based proximity operators 


Many algorithms in optimization in a real Hilbert space Li are based on Moreau’s proximity operator 
I1T31 of a function p G To(7f) 

prox^; Li y Li x i —y argmin (p + || • -x|| 2 /2). (3.1) 

Because the quadratic term in (13.1ft is difficult to manipulate in Banach spaces since its gradient is 
nonlinear, alternative notions based on Bregman distances have been used (see J4J and the refer¬ 
ences therein). This leads to the notion of D- 1 -proximal operators. In this section, we investigate 
some their basic properties. 

Lemma 3.1 0] Section 3] Let X be a reflexive real Banach space, let p G To(A’) be bounded from 
below, and let f £ Tq(X) be a Legendre function such that domc^ n int dom/ / 0. Then the following 
hold: 

(i) proxjf is single-valued on its domain. 

(ii) ran prox£ c dom prox£ = int dom/. 

(hi) prox£ = (V/ + dp)~ l o V/. 

(iv) Fix proxjf = Argmin p n int dom/. 

(v) Let x G Argmin p n int dom/, let y G int dom/, and let v = pro yjy. Then 

D f {x, v ) + Df(v, y ) ^ Df(x, y). (3.2) 
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The following result in an extension of |]5} Proposition 23.30], 

Proposition 3.2 Let m be a strictly positive integer, let (T ',be reflexive real Banach spaces, and 
let X be the vector product space X; = 1 <T; equipped with the norm x = (x;)i^ m ^ \//C"=i ll x '*ll 2 - 
For every i G {1,... ,m}, let <p; G To(T’j) be bounded from below and let fi G To(T;) be a Legendre 
function such that dom 99 ; n int dom/; f 0. Set f: X —>■ ]—oo,+oo] : x >->■ YliLi fi( x i) am 1 P'- X —> 
]-oo, +oo] : x i-)- Y11L 1 Then 

m 

(VxG Xintdom/;) proxjx = (proxj a;*) . (3.3) 

V i=l 7 ^ ^ 


Proof. First, we observe that X* is the vector product space X™ , X* equipped with the norm 
x* = !->■ II®*II 2 - Since, for every i G ( 1 ,..., m}, <p; is bounded from below, so is p. 

Next, we derive from the definition of / that dom / = X™ , dom /, and that 

m 

df: X 2 X * : (x;) i^»< m X dfi(xi). (3.4) 

i=l 

Thus, df is single-valued on 

mm m 

dom df = X dom dfi = X int dom/; = int ( X dom fi) = int dom/. (3.5) 

i=i i=i n=i ' 

Likewise, since 


f*:X*^ ]-oo, +oo] : (x*)r^ m X] /*(**)> (3-6) 

i =1 

we deduce that df* is single-valued on dome)/* = int dom/*. Consequently, |[3l Theorems 5.4 
and 5.6] assert that / is a Legendre function. In addition, 

mm m 

dom tp n int dom/ = ( X dom pi J n f X int dom/; J = X (dom pi n int dom/;) f 0. (3.7) 

'■i=l ' X =1 ' i=l 


Now Lemma [3TT1 asserts that prox£: int dom/ -g dom<p n int dom/. For the remainder of the proof, 
let x € int dom/, setp = prox^x, and set q = (prox£.x;)i<;^ m . Since Lemma l3.1|l(iii) |vields V/(x) — 
V/(p) € dp(p), we deduce from (II.ID that 


(Vz G dom </?) (z - p,X7 f(x) -V f(p)) + p(p) ^ p(z). (3.8) 

Setting z = q in (13.81) yields 

(9 - P, V/(s) - V/(p)) + ¥>(p) < y>(g). (3.9) 

For every i G {1,... , m}, set q t = prox^.x;. The same characterization as in (13.81) yields 

(Vi €{!,... ,m})(Vz; G dom y?;) (z; - q u V/;(x;) - V /;(<?;)) + <p;(%) < (3.10) 
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By summing these inequalities over i G {1,..., m}, we obtain 

(Vz G dom ip) (z - q,Vf(x ) - V/(g)} + 99(g) ^ 99(2;). 


(3.11) 


Upon setting z = p in (13.11ft . we get 

(V - q, v/(x) - V/(g)) + <p(g) < 99(1?). 


(3.12) 


Adding (13.9ft and (13.121) yields 


(p-?,v/(p)-v/(?)K 0 . 


(3.13) 


Suppose that p / q. Since / is essentially strictly convex, / is strictly convex on every convex subset 
of dom df. In particular, since intdom/ c dom df, /lintdom/ is strictly convex. Hence, by [ 191 
Theorem 2.4.4(h)], V/ is strictly monotone, i.e., 


(p-?,V/(p)-V/(?)) >0, 


(3.14) 


and we reach a contradiction. Consequently, p = q which proves the claim. □ 

Let us note that, even in Euclidean spaces, it may be easier to evaluate prox£ than Moreau’s usual 
proximity operator prox^,, which is based on/ = ||-|| 2 /2. We provide illustrations of such instances 
in the standard Euclidean space M m . 

Example 3.3 Let 7 G ]0,+oo[, let cj) G To(M) be such that dom^ n ]0,+oo[ / 0 , and let d be 
Boltzmann-Shannon entropy, i.e.. 


£ln£ —if £ G ]0, +oo[; 


(3.15) 


if £ = 0; 

+00, otherwise. 


Set p: ^ and f : (&) YliL i $(&)■ Note that / is a Legendre function 

in Theorem 5.12 and Example 6.5] and hence, Lemma [3TT1 asserts that domprox^ = ]0, +oo[ m . Let 
((i)i«m G ]0, +oo[ m , set = prox^(^)i^ <m , let W be the Lambert function iQjO]], i.e., the 

inverse of ^ i—on [0, +oo[, and let * G {1,, m}. Then 77 , can be computed as follows. 

(i) Let wGl and suppose that 

£ ln£ — if £ G ]0, +oo[; 


.+00, 


if £ = 0; 


(3.16) 


otherwise. 


Then m 

(ii) Let p G [1, +00 [ and suppose that either f> = | * \ p /p or 


(oj—1)/(7+1) 



f, p /p, if £ G [0, +00[; 
+00, otherwise. 


(3.17) 
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Then 


( Vfrfr-i)#- 1 ) 

m \ 7 (p -1) 


1 

P-1 


, if p <E ]l,+oo[; 

if p = 1. 


(3.18) 


(iii) Let p € [ 1, +oo[ and suppose that 

i~ p /p, if £ <E ]0,+oo[; 




+oo, otherwise. 


(3.19) 


Then 


Vi = 


W( 1 (p+ 1 )£ 


-1 

-p-l\ \ p+ 1 


l 7(P+1) 


(3.20) 


(iv) Let p g ]0,1[ and suppose that 

-■P/.P, if £ <E [0,+oo[; 




+oo, otherwise. 


(3.21) 


Then 


Vi = 




(3.22) 


\ 7(1 ~P) 

Example 3.4 Let cj) G Tq(M) be such that dom0 n ]0,1[ / 0 and let i? be Fermi-Dirac entropy, i.e., 


t?: £ i->- < 


£ln£-(l-£)ln(l-£), if e e ] 0 , 1 [; 
o if <e e { 0 , 1 }; 

+oo, otherwise. 


(3.23) 


Set ip: (&)iE™i<K&) and f- (&) t^i^m E(:=i $(&)■ Note that / is a Legendre function 
1121 Theorem 5.12 and Example 6.5] and hence, Lemma [3TT1 asserts that domprox^ = ]0, l[ m . Let 
(£?') G ]0, l[ m , set (pi)i<j< m = prox£(&)i <i<mj and let i € {1,, m}. Then 77 ^ can be computed 

as follows. 


(i) Let oj € M and suppose that 

<t>: £>-> < 


£lnif £ £ ] 0 , +oo[; 
0 , if £ = 0 ; 

+ 00 , otherwise. 


(3.24) 


Then Vi = e"(2 - 2&)- 1 (-& + J4& ~ 3£ 2 )- 
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(ii) Suppose that 


</>■■ £ ^ < 


(1 - £) ln(l - £) + £, if e e ]—oo, 1 [: 

l if £ = 1; 

+oo, otherwise. 


(3.25) 


Then Vi = 1/2 + ^/2 - ^£/ 2 /4 + £^2 - 3/4. 

Example 3.5 Let <f> G Tq(M) be such that dom 0 n ] 0 , +oo[ 7 ^ 0 and let $ be Burg entropy, i.e., 


1): £ 1-7 


— ln£, if £ G ] 0 , +oo[; 
+00, otherwise. 


(3.26) 


Set <p: (£i)r^ m and /: (£;) t^i^m $(£*)• Note that / is a Legendre function 

If2l Theorem 5.12 and Example 6.5] and hence, Lemma I3TT1 asserts that domprox^ = ] 0 , +oo[ m . 
Let (£*) G ] 0 ,+oo[ m , set (r/j) 1<i<rn = pro x£(£j)i^ m , and let i G {1,... ,m}. Then r/, ; can be 
computed as follows. 


(i) Let 7 G ] 0 , +oo[ and suppose that = 71 ?. Then 77* = (1 + 7 )£;. 

(ii) Let ( 7 , a) G [ 0 , +00 [ 2 , let wGl, and suppose that 

f —7 In £ + cu£ + a£ _1 , 

+00, 


>: £ ^ 


if £ G ] 0 , +oo[ j 

otherwise. 


(3.27) 


Then ip — (2 + 2ca£j) x ((7 + l)£j + 7/(7 + l) 2 £i + 4a£j(l + w£i)). 

(iii) Let (7, a) G [0, +oo[ 2 , let p G [1, +oo[, and suppose that 

J —7 ln£ + a£ p , if £g] 0 ,+oo[; 

l+oo, otherwise. 

Then rp is the strictly positive solution of />a£,r/ p + p = (7 + 1 )£,.. 

(iv) Let a G [0, +00 [, let p G [1, +00 [, and suppose that 

ac / a £ ^ £ £ ]o> +°°[; 

<p : £ ^ , 

l+oo, otherwise. 

Then rp is the strictly positive solution of pr/ p+1 — £,'//’ = op£,. 

Example 3.6 Let/: (£) is 77 m ^ X/I=i ^(£i)j where 1 ? is Hellinger-like function, i.e., 

’-\A-£ 2 , if £ G [—1,1]; 

+00, otherwise, 


(3.28) 


(3.29) 


0 : £ ^ 


(3.30) 


let 7 G ] 0 ,+oo[, and let = /. Note that / is a Legendre function 021 Theorem 5.12 and Exam¬ 


ple 6.5] and hence, Lemma I3TT1 asserts that domprox^ = ] —1, l[ m . Let (£, 




G ] — 1, l[ m and set 


fa*)i<i<m = prox4,(£i)i^ m . Then ( v * € {1- • • ,m}) ry* = fi/y'(7 + l) 2 + (h 2 + 27 + 2)£?. 
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4 Applications 


4.1 Variable Bregman proximal point algorithm 

The convex minimization problem, i.e., the problem of minimizing a convex function, can be solved 
by proximal point algorithm (see |]5]|9] for Hilbertian setting and 0] for Banach space setting). In 
this section, we develop a proximal point algorithm which employs different Bregman distances at 
each iteration. This provides a unified framework for existing proximal point algorithms. 

Theorem 4.1 Let X be a reflexive real Banach space, let p £ To (A), let / £ To(A’) be a Legendre 
function such that Argmin (p n int dom/ 0 , let ( q n ) n £ f+(N), let a £ ]0, +oo[, and let (f n )ne n be 
Legendre functions in T Q (/) such that 

(Vne N) (l + r,n)fn> fn+l. (4.1) 

Let xo £ int dom/, let (j n )neN £ ]0, +oo[ N be such that 7 = inf ne ^ y n > 0, and iterate 

(Vn € N) x n+ i = prox^x n . (4.2) 

Then the following hold: 

(i) (^n)neN is stationarily Bregman monotone with respect to Argmin p relative to (f n )ne n- 

(ii) (.x n ) ne N is a minimizing sequence of <p. 

(iii) Suppose that, for every x £ int dom/, D f ( x , •) is coercive, and that one of the following holds: 

(a) Argmin p n dom f is a singleton. 

(b) Either Argmin p c int dom/ or dom f* is open and V/* is weakly sequentially continuous, 
there exists g £ 3~(/) such that, for every n £ N, g ^ f n , and, for every x\ £ X and every 
X 2 £ X, 

xi £ 2U(a; n ) n £pj 

< x 2 £ 2U(x n ) nG N => xi = X‘ 2 ■ (4.3) 

, «®i - x 2 , V/ n (x n )» neN converges 

Then there exists x £ Argmin p such that x n —>■ x. 

(iv) Suppose that that f satisfies Condition 12. 11 1 and that (Vx £ int dom/) Df (x, •) is coercive. Fur¬ 
thermore, assume that lim -D^ gTTlin (x w ) = 0 and that there exists (3 £ ]0, + 00 [such that (Vn £ N) 
/3f I 7 f n . Then there exists x £ Argmin p such that x n —> x. 

Proof. First, for every n € N, since 0 f Argmin <p n int dom / c dom p n int dom/ = dom p n 
int dom/ n , Lemma I3TT1 asserts that 

prox/™^: int dom/ n —* dom dp n int dom/ n (4.4) 
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is well-defined and single-valued. Note that xo £ int dom/. Suppose that x n £ int dom/ for some 
n £ N. Then x n £ int dom/ n , and hence, we deduce from (14.41) that x n+ ± £ domcLp n int dom/ n c 
int dom/. By reasoning by induction, we conclude that 

(x n ) n£ N £ (int dom/) N is well-defined. (4.5) 


(TJl We hrst derive from (14.21) and Lemma !3.1]Kiii)| that 


(Vn £ N) V/ n (x n ) - V/ n (x n+ i) £ 7 n <9(p(x n+ i). (4.6) 

Next, by invoking (II.ID and (I4.6D . we get 

(Vx £ domipndom/)(Vn £ N) 7 “ 1 (x - x n+i , V/ n (x n ) - V/ n (x n+ i)) + <p(x n +i) ^ <p(x). (4.7) 
It therefore follows from [3i Proposition 2.3(h)] that 

(Vx £ dom<p n dom /)(Vn £ N) 7 ~ 1 (T> /n (x,x n+ i) + £> /n (x n+ i, x n ) - D fn (x,x n )) 

+ <p(x n+ i) < ip(x), (4.8) 


and, in particular, 

(Vx £ Argmin ip n dom /)(Vn £ N) D fn (x, x n+1 ) < D fn (x,x n ) - D fn (x n+ i,x n ). (4.9) 

Since (14.ID yields 

(Vx £ Argmin ip n dom/) (Vn £ N) D^ n+1 (x, x n+ \) < (1 + rj n )D^ n (x, x n +i), (4.10) 

it follows from 04.9D that 

(Vx £ Argmin <p n dom/)(Vn £ N) D^ n+1 (x,x n+ 1 ) < (1 + r/ n )D^ n (x,x n ) 

- (1 + r] n )D fn (x n+ i,x n ). (4.11) 


In particular, 

(Vx £ Argmin ip n dom/) (Vn £ N) D-^ n+1 (x, x n+ \) ^ (1 + r/ n )D^ ri (x, x n ). (4.12) 

This shows that (x n ) n <=N is stationarily Bregman monotone with respect to Argmin <p relative to 

(/n)ngN- 


[CiiJt Let x £ Argmin <p n int dom/. It follows from [(I)] and Proposition 12 .fllfi)] that 
(D fn (x,x n )) n&N converges 
and, since (14.1 ID yields 


(4.13) 


(Vn £ N) D fn (x n+ i,x„) ^ (1 + rj n )D fn (x n+ i,x n ) 

^ (1 + rj n )D fn (x,x n ) - D fn+1 (x,x n+1 ), (4.14) 
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we deduce that 


D fn (x n+ i,x n ) ->■ 0. (4.15) 

On the other hand, since (/ n ) n eN is i n we obtain 

(Vn G N) aD f (x n+1 ,x n )^D fri (x n+ i,x n ). (4.16) 

Altogether, (14.151) and (14.161) yield 

D f (x n+ i,x n ) 0. (4.17) 


We also deduce from (14.8D that 

(Vn G N) tp(x n+1 ) < 'y~ 1 (D fn (x n ,x n+ i) + D fn (x n+1 ,x n )) + v(x n +i) < ip(x n ). (4.18) 

This shows that (c p(x n )) n£ n is decreasing, and hence, since it is bounded from below by inf <p(X), it 
converges. We now derive from (I4.8D and (14.101) that 


(Vn G N) - 


1 / 1 


7 \ 1 + % 

1 


D fn+1 (x,x n+1 ) + D fn (x n+ i,x n ) - D fn (x,x n ) +ip(x n+ 1 ) 




7 n 


( — D fn+1 (x,x n+ 1 ) + D fn (x n+ i,x n ) - D fn (x,x n ) ) + <p(x n+ i) 

\1 + Vn J 


^ <p(x). (4.19) 

Hence, by using (14.13D and (I4.15D after letting n —>• +oo in (I4.19D , we get 

inf' ip(X) ^ lirri <p(x n ) ^ <p(x) = inf <p{X). (4.20) 

In turn, (p(x n ) —>• inf tp(X), i.e., (x n ) nG pf is therefore a minimizing sequence of <p. 

(iii)l We show actually that 2B(a; n ) ne N C Argmimp. To this end, suppose that x G 2U(xn)neN, 
i.e., Xk n — 1 x. Since is lower semicontinuous and convex, it is weakly lower semicontinuous [ I9l 
Theorem 2.2.1], and hence, 


inf ip(X) ^ ip(x) < lim^(xfc n ) = inf <p(X). 


(4.21) 


In turn, <p(x) = inf tp(X), i.e., x G Argmincp. 

(iii) (a) 1 Since X is reflexive, we derive from [CD] and Proposition 12.^KiiTI that 2H(x n )neN 0- Let 
us fix x G W(x n ) ne ^. Since (I4.5D yields 3U(a; n ) n£ n c Argmin<p n dom/, we get 2U(x n ) ne N = {x}. 
In turn, x n — 1 x. 


(iii) (b) We shall show that 2IJ(a; n ) ne N C int dom/. To this end, let x G 2U(x n ) nG N, he., Xk n 


x. 


If Argminy? c int dom/ then x G Argmimp c int dom/. Now suppose that dom /* is open and 
V/* is weakly sequentially continuous. Let x G Argmimp n int dom/. Then V/(x) G int dom/* 
Il3l Theorem 5.9] and it follows from ||3] Lemma 7.3(v)] that Vf(x)) is coercive. Since 

(D?(x,Xk n ))neN is bounded and since 01 Lemma 7.3(vii)] asserts that 


(Vn G N) Df*(Vf(x kn ), V/(*)) = Df(x, Xkn ), 


(4.22) 
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we deduce that (V/(xfc n )) nG N is bounded. Take x* £ X* and a strictly increasing sequence (pk n )n £n 
in N such that V/(x Pfe ) — 1 x*. Since (3} Lemma 7.3(h)] states that D (•, V/(x)) is a proper lower 
semicontinuous convex function, we derive from (I4.22D that 

Df\x*yf{x)) ^lim^’(V/(x Pfc J,V/(x)) ^ ljmD f (x,x Pkn ) < +oo, (4.23) 

which shows that x* £ domf* = intdom f* and thus, by [3] Theorem 5.10], there exists x\ £ 
int dom/ such that x* = V/(xi). Since V/* is weakly sequentially continuous, we get 

x - x Pkn = Vf(V/( % J) - V/*(x*) = xl (4.24) 

In turn, x = x\ £ int dom/. Finally, the claim follows from Proposition 12.71 

|(iv)] Since <p £ To(<T), Argmincp is convex and closed, and the assertion therefore follows from 
Proposition 12.121 □ 

Remark 4.2 In Theorem l4.ll suppose that (Vn £ N) f n = f, y n = 7, and r) n = 0. Then (I4.2D reduces 
to the Bregman proximal iterations 0] 

(Vn £ N) x n+ i = prox^x n . (4.25) 


4.2 An application to the convex feasibility problem 

In this section, we apply the asymptotic analysis of variable Bregman monotone sequences to study 
the convex feasibility problem, i.e., the generic problem of finding a point in the intersection of a 
family of closed convex sets. We first recall the following results. 

Lemma 4.3 (4] Definition 3.1 and Proposition 3.3] Let X be a reflexive real Banach space, let f £ 
To (A) be Gateaux differentiable on int dom/ f 0, set 

(V(x, y) £ (int dom/) 2 ) H f (x, y) = {z £ X \ (z - y,Vf(x) - V/(y)) ^ 0} 

= {z £ X | D^(z,y) + D^(y,x) ^ D^(z : x)} (4.26) 


and 


»(/) = { T : 


X 


1 * 


ran T c dom T = int dom/ 

and (V(x, y) £ graT) Fix T c fT^(x,y)|. (4.27) 


Let T £ 9S(/) be such that FixT f 0. Suppose that /lintdom/ is strictly convex. Then the following 
hold: 


(i) FixT is convex. 

(ii) (Vx € FixT)(V(?/, v) £ gra T) D f (x,v ) + D f (v,y ) ^ D f {x,y). 
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The class of operators 35 includes types of fundamental operators in Bregman optimization (see 
lf4H for more discussions). We illustrate our result in Section[2]through an application to the problem 
of finding a common point of a family of closed convex subsets with nonempty intersection. 

Theorem 4.4 Let X be a reflexive real Banach space, let I be a totally ordered at most countable index 
set, let (Ci)i£i be a family of closed convex subsets of X such that C = f") ig T Ci f 0, let f G To(T’) 
be Gateaux differentiable on int dom/ f 0, let (r/ n )neN € ^+(N), let a G ]0, +oc[, and let (f n )ne n be 


Legendre functions in T a (/) such that 

(Vn € N) (1 + rjn)fn> fn+ 1 . (4.28) 

Let i: N —> I be such that 

(Vj G G N\{0})(Vn G N) j G (i(n),..., i(n + Mj - 1)}. (4.29) 

For every i G I, let (Ti >n ) ne ^ be a sequence of operators such that 

(Vn G N) T i n G Q3(/ n ), Ci n Fix 7*^ ^ 0 , and Q C FixT^. (4.30) 

Let xq G int dom/ and iterate 

(Vn G N) x n+ i G Tq n ^ n x n . (4.31) 


Suppose that f satisfies Condition ^. 11\ and that (Vx G int dom/) J)l (x, •) is coercive. Then there exists 
x G C such that the following hold: 

(i) Suppose that there exists g G 'T(f) that, for every n G N, g ^ f n , and, for every xi G X and every 

x 2 G X, 


x\ G 2U(x„) nGN H C 

< x 2 G 2B(x n ) nG M n C* => xi=x 2 , (4.32) 

. ((xi - x 2 , V/ n (x n ))) rigN converges 

and that, for every strictly increasing sequence (( n ) nG n in N, every x £ X, and every j G /, 


x;„ x 

Uln ^ Tj,l n ‘ X ln 

yi n 

k (Vn G N) j = i(/„) 


x G tVj. 


(4.33) 


In addition, assume that 2IJ(x n ) nG N C int dom/. Then x n x. 

(ii) Suppose that f is Legendre, that lim D^Xn) = 0, and that there exists (3 G ]0,+oo[ such that 
(Vn G N) /3f > f n . Then x n x. 
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Proof. For every n £ N and every i £ I, we observe that ran 7) ,n C dom7/ n = int dom f n = int dom/. 
Hence, it follows from 04.301) and (14.3ID that (x n ) n eN is a well-define sequence in int dom/. We now 
derive from (14.26 1) , (14.301) . and (14.3ID that 

(Vx £ C fl dom/)(Vn € N) D fn (x, x n+ i) + D fn (x n+1 , x n ) < D fn (x, x n ). (4.34) 

Since (14.28D yields 

(Vx £ C n dom/)(Vn € N) D fn+1 (x, x n+1 ) < (1 + rj n )D fn (x, x n+1 ), (4.35) 

we deduce that 


(Vx € Cndom/)(Vn € N) D fn+ 1 (x,x n+ 1) ^ (l + Tj n )D fn (x,x n )~ (l + r] n )D fn (x ri+ 1 ,x n ). (4.36) 


In particular, 

(Vx £ C n dom/)(Vn £ N) _D^" +1 (x, x n+ i) ^ (1 + rj n )D^ n (x,x n ), (4.37) 

which shows that (x n ) n eN is stationarily Bregman monotone with respect to C relative to {f n ) n m- In 
addition, we derive from (14.301) that (Vi £ {1,..., m}) Q Cl int dom/ 0 . Hence, Cnint dom/ f 0 . 

[(1)1 In view of Proposition [2771 it suffices to show that 2U(xn)neN C C flint dom/. To this end, let 
x £ 2H(x„) ne N, let (fc n )neN be a strictly increasing sequence in N such that Xk n — 1 x, let j £ I, and 
let x £ C n int dom/. By (14.29D , there exists a strictly increasing sequence (l n )ne N i n N such that 


(Vn £ N) 


k n ^5 In ^ k n T AFj — 1 < ^n+1 ^ (n+1) 

j = Kin)- 


(4.38) 


Since D? (x, •) is coercive, it follows from Proposition l2.6l that (x n )eN is bounded and (D^ n (x n+ i, x n ))neN 
converges. In turn, since (14.361) yields 

(Vn £ N) D fn (x n+ 1 , x n ) ^ (1 + rj n )D fn (x n+1 ,x n ) 

^ (1 + ri n )D fn (x,x n ) - D fn+1 (x,x n+ i), (4.39) 


we deduce that 


(x n+ i, Xn) ^ 0. (4.40) 

However, since 

(Vn £ N) aD f (x n+1 ,x n )^D fn (x n+ i,x n ), (4.41) 

it follows from (14.401) that 

iy(x n+ i,x n ) 0 (4.42) 

and hence, since / satisfies Condition 12.Ill 

Xn+i — x n —> 0. (4.43) 
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Altogether, (14.38D and (14.431) imply that 


kn~\~Mj —2 

|| X in - x k J ^ V ||x m+ i -x n \\ < (Mj - 1) max ||x m +i - x m \\ -s- 0, (4.44) 

z — * kn^m^kn+Mj—2 

m=k n 

and therefore 

xi n ->• x. (4.45) 

Now let (Vn £ N) yj n £ Tj } i n xi n . We deduce from (14.38D and (14.43D that 

Vin ~ x in (4.46) 

By invoking successively (14.33D . (14.45D . and (14.461) , we get x £ C 3 , and hence, x £ C. Consequently, 

21J(x n ) ne M C C n int dom/. 

1 (ii) 1 Since C is closed, the assertion follows from Proposition [2T2j □ 

Remark 4.5 


(i) In Theorem 14.41 suppose that (Vn £ N) f n = f and ?/ n = 0. Then we recover the framework of 
Il4l Section 4.2], 

(ii) In Theorem 14.41 suppose that A” is a Hilbert space, that / = || • || 2 /2, and that (Vn £ N) 

f n : (x, U n x) / 2, where (U n ) ne n are operators in Ta(A’) such that sup„ gN \\U n \\ < +oo and 

(Vn £ N) (1 + rj n )U n ^ U n+ \. Then we recover the version of [|9, Theorem 5.1 (i) and (iii)] 
without errors and (Vn £ N) X n = 1. 


Our last result concerns a periodic projection method that uses different Bregman distances at 
each iteration. 


Corollary 4.6 Let X be a reflexive real Banach space, let m he a strictly positive integer, let 
be a family of closed convex subsets of X such that C = fj^Li Ci / 0, let f £ To(A’) be Gateaux 
differentiable on int dom/ such that C Cl int dom/ 0, let (p n )nm € ^+(N), let a £ ]0, 4-oo[, and let 

(/n)ne n be Legendre functions in (Pa(/) such that 

(Vn £ N) (1 + Pn)fn> fn+1. (4.47) 


Let xq £ int dom/ and iterate 

(Vn £ N) x n+ i = Pjf 


l+rem(n,m) 


(4.48) 


where rem (•, m) is the remainder of the division by m. Suppose that f satisfies Condition 12. 11 1 and that 
(V.x £ int dom/) D? (x, ■) is coercive. Then there exists x £ C such that the following hold: 
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(i) Suppose that there exists g £ 3 ~(/) such that, for every n £ N, g f n , and, for every x\ £ X and 
every x 2 £ X, 

x\ £ 2D(x^)^£i^ n C 

< x 2 £ 22J(x n ) nG N n C => aq = x 2 . (4.49) 

k «®i - ® 2 , V/„(x„))) neN converges 

In addition, suppose that 2B(x n ) nG N C intdom/. Then x n —^ x. 

(ii) Suppose that f is Legendre, that lim D c (x, n ) = 0, and that there exists j3 £ ]0,+oo[ such that 
(Vn £ N) (3f > f n . Then x n -3 x. 


Proof. First, we see that the function i: N —> {1, ..., m }: 1 + rem(n, m) satisfies (I4.29D , where 

(Vj £ m}) Mj = m. Now set 


(Vi £ {1,, m})(Vn £ N) T ijU = p/t. 

Then, by [4l Theorem 3.34], for every n £ N and every i £ {1,..., m}, we have 


£ *B(/ n ) and C) n dom / n Fix7/ n = C t n int dom/ D C n int dom/ f 0. 
In addition, it follows from |]4[ Lemma 3.2] that 


(4.50) 


(4.51) 


(Vn £ N)(Vi £ {1,... , m}) Ci n dom / = C) n int dom/ = C) n int dom/ n = Fixl/ n . (4.52) 

Therefore, (14.481) is a particular case of (I4.31D . We shall actually apply Proposition 14.41 with the 
family (C t n dom/)i^ i<m . 

[ClTt Let us fix j £ {1,..., m} and suppose that 

xi n ->■ x, Tjj n xi n - x in -£ 0, and (Vn £ N) j = i (l n ). (4.53) 

x 

Then C 3 3 Pc nx i n = Tj,i n xi n x, and hence, x € Cj since Cj is weakly closed [18, Corollary 4.5], 

Moreover, since (x n ) ne pj is in int dom/, x £ dom / and hence x £ Cj ndom /. This shows that (I4.33D 
is satisfied. Consequently, the assertion follows from Proposition I4.41i)l 


(ii): We have 


(Vn £ N) 


inf D f (x,x n )^ inf D f (x,x n ) = DL(x n ), 

xGCndom f 


(4.54) 


xGCtldom f 

and hence, lim Dcridomf (x n ) = 0. The claim therefore follows from Proposition 14.41ii)l □ 
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